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INTEGRAL & DIFFERENTIAL CALCULUS FOR ADVANCED STUDENTS 



INTEGRATION 




DEFINITIONS 



•Heuristics. The definite integral captures the idea of 
adding the values of a function over a continuum. 

'Riemann sum. A suitably weighted sum of values. A 
definite integral is the limiting value of such sums. A 
Riemann sum of a function / defined on [a, b] is 
determined by a partition, which is a finite division of 
[a,b] into subintervals, typically expressed by 
a=x 0 <x l " , <x ll =b; and a sampling of points, one point 
from each subinterval, say c t from \xi_\, Xf]. The associated 
/( 

Riemann sum is: ^f{a)(xi — Xi-i). 

i = l 

A regular partition has subintervals all the same length, 
Ax = (b-a)/n, Xj = a+iAx. A partition's norm is its 
maximum subinterval length. A left sum takes the left 
endpoint Cf=Xi_\ of each subinterval; a right sum, the 
right endpoint. An upper sum of a continuous / takes a 
point Cj in each subinterval where the maximum value of / 
is achieved; a lower sum, the minimum value. E.g., the 
upper Riemann sum of cosjc on [0,3] with a regular 
partition of n intervals is the left sum (since the cosine is 

decreasing on the interval): ^[cos((t— + 



•Definite integral. The definite integral of / from a to b 
may be described as f f(x)dx— lim y]f(a)Asi. 

The limit is said to exist if some number S (to be called the 
integral) satisfies the following: Every £>0 admits a d 
such that all Riemann sums on partitions of [a, b] with 
norm less than 8 differ from S by less than e. If there is 
such a value S, the function is said to be integrable and the 

value is denoted f f(x)dx or f f . The function must be 

Ja -'a 

bounded to be integrable. The function / is called the 
integrand and the points a and b are called the lower limit 
and upper limit of integration, respectively. The word 

rb 

integral refers to the formation of / f from / and [a, 6], as 

well as to the resulting value if there is one. 
* Antiderivative. An antiderivative of a function / is a 
function A whose derivative is /: A'(x)=f(x) for all x in 
some domain (usually an interval). Any two antiderivative s 
of a function on an interval differ by a constant (a 
consequence of the Mean Value Theorem). E.g., both 

-^■(x - a) 2 and ^x 2 —ax are antiderivative s of x-a, 

differing by ^Gf 2 - The indefinite integral of a function /, 

denoted jf{x)dx, is an expression for the family of 
antiderivatives on a typical (often unspecified) 
interval. E.g., (forjc<— 1, orfor:t>l). 



. g — dx=/x TII i + C. 



The constant C, which may have any real value, is the 
constant of integration. (Computer programs, and this 
chart, may omit the constant, it being understood by the 
knowledgeable user that the given antiderivative is just one 
representative of a family.) 



INTERPRETATIONS 



•Area under a curve. If /is nonnegative and continuous on 
[a,b], then / a f(x)dx gives the area between the jc-axis 

b 

and the graph. The area function A(x)= / X f(t)dt gives 

J a 

the area accumulated up to .v. If / is negative, the integral 
is the negative of the area. 

•Average value. The average value of / over an interval [a, b] 

may be defined by average value = ^]_ a J f(x)dx. 

A rough estimate of an integral may be made by estimating 
the average value (by inspecting the graph) and 
multiplying it by the length of the interval. (See Mean 
Value Theorem (MVT) for integrals, in the Theory section. ) 
•Accumulated change. The integral of a rate of change of 
a quantity over a time interval gives the total change in the 
quantity over the time interval. E.g., if v(t)=s'(t) is a 
velocity (the rate of change of position), then v(/)A/ is the 
approximate displacement occurring in the time increment 
/ to t+At; adding the displacements for all time increments 
gives the approximate change in position over the entire 
time interval. In the limit of small time increments, one 

gets the exact total displacement: f v( t)dt=s(b)—s(a). 

•* a 

•Integral curve. Imagine that a function / determines a 
slope f(x) for each .v. Placing line segments with slope 
f(x) at points (x,y) for various y, and doing this for various 
x, one gets a slope field. An antiderivative of/is a function 
whose graph is tangent to the slope field at each point. The 
graph of the antiderivative is called an integral curve of 
the slope field. 

•Solution to initial value problem. The solution to the 
differential equation y'=f(x) with initial value y(Xfj)~y^ is 



(x)=yo+ f X f(t)dt 



THEORY 



■ Integrability & inequalities. A continuous function on a 
closed interval is integrable. Integrability on [a, b] implies 
integrability on closed subintervals of [a,fr]. Assuming/is 
integrable, if L<,f{x)<,M for all x in [a, b], then 

L-(b-a)< f h f(x)dx<M-(b-a). 

•Ja 

Use this to check integral evaluations with rough 
overestimates or underestimates. 




If /is nonnegative, then f f(x)dx is nonnegative. 

J a 

If /is integrable on [«,&], then so is / and 
\( b f(x)dx\<f'\f(x)\dx. 

Fundamental theorem of calculus. One part of the 
theorem is used to evaluate integrals: If /is continuous on 
[a,b], and A is an antiderivative of / on that interval, then 

( h f(x)dx=A(x)\ b =A(b)-A(a). 

The other part is used to construct antiderivatives: 

If / is continuous on then the function 

A(x)\= x f(t)dt is an antiderivative of / on [«,£]: 

•> a 



A'(x)=f(x) (valid for one-sided derivatives at the 
endpoints). 



Fundamental Theorem 




'Differentiation of integrals. Functions are often defined 
as integrals. E.g., the "sine integral function" is 

To differentiate such, use the second part of the 
fundamental theorem: Si'(x)=sinx/x. A function 

such as f f(t)dt is a composition involving 

-' a 

A(u) = / "f(t)dt. To differentiate, use the chain rule 

J a 

and the fundamental theorem: 

^ fy(,t)dt=^A(x 2 )=A'(x 2 )2x=2xf(x 2 ). 

■Mean value theorem for integrals. If / and g are 

continuous on [a,b], then there is a ^ in [a,b] such that 

f*f(x)g(x)dx=f{%)fj(x)dx. 

In the case the average value of / is attained 
somewhere on the interval: -7- / f(x)dx— f{£). 

O Ct ~ a 



MVT for Integrals 




• Change of variable formula. An integrand and limits of 
integration can be changed to make an integral easier to 
apprehend or evaluate. In effect, the "area" is smoothly 
redistributed without changing the integral's value. If g is 
a function with continuous derivative and / is continuous, 

then f f(u)du—f f(g(t))g' (t)dt, where c,d are 

points withg(c)=a and g(d)=b. 

In practice, substitute u=g(t); compute du=g'(t)dt; and 
find what / is when u=a and u=b. E.g., «=sin/ effects the 



transformation / -J \ — ir da — / /l — sin- 1 cos t dt, 

J a -/0 

which becomes / cos" t dt, since yl— sin-f — cos t 

for 0<t<7l/2. The formula is often used in reverse, 

starting with fF(g(x))g' (x)dx. See Techniques on pg. 2. 

•Natural logarithm. A rigorous definition is In x = 
C x 1 

J ~^du. The change of variable formula with u=l/t 



that 



yields J2^ u = J 1 = ~ j l jdt showing 

\n(llx) = -In*. The other elementary properties of the 
natural log can likewise be easily derived from this 
definition. In this approach, an inverse function is deduced 
and is defined to be the natural exponential function. 



INTEGRATION FORMULAS 



•Basic indefinite integrals. Each formula gives just one 
antiderivative (all others differing by a constant from that 
given), and is valid on any open interval where the 
integrand is defined: 



r v n I 1 

J n + 1 

fcos x ctc=sin x 



f dx _ 

h+x 2 -"— - 

• Further indefinite integrals. The above conventions hold: 
Jitan x cfa=ln|sec x| ^cot x cfcc=ln|sin x\ 

Jsec x dj:=ln|sec x+tan x\ 
Jcsc x efa=ln|csc jc+cot x\ 
Jcosh x <£«: = sinh ^sinn j; cfc = cosh jc 

/x 2< ^a 2 = M ln |f+f| j x dx=\xx 

f . dx ^ lnlx+TjcH^hsinh-'g+lna 
J « +a- a 

/"-7== = In | x + 77a 5 Icosh - 1 % + In a 

(take positive values for cosh -1 ) 

J^/ x 2 +a 2 dx=^x</x 2 a 2 ±^ln\x+ </x 2 ±a 2 \ 

(Take same sign, + or -, throughout) 

yVa 2 — x 2 dx=^x</a 2 x 2 + ^-arcsin^ 

•Common definite integrals: 

f 1 x"dx=^j-zr fWr 2 -x 2 dx=^P f\mxdx=2 
Jo n + 1 Jo 4 Jo 

r / co S 2 erfe=r /2 l±f^e^-^ 

Jo Jo I 



arctan x 



^dx=Xn\x\ 

fa x dx=^-(ai=l) 
J \na 

J sin x dx= — cos x 

I: 



dx _„ 



r%m 2 ede=r /n -=<f^de=% 

Jo Jo 2 4 

To remember which of V3 (l±cos 28) equals cos 2 8 or 

sin 2 6, recall the value at zero. 



TECHNIQUES 



•Substitution. Refers to the Change of variable formula 

(see the Theory section), but often the formula is used in 
reverse. For an integral recognized to have the form 

f F(g (x))g' (x)dx (with F and g' continuous), you can put 

Ja 

u=g(x), du=g'(x)dx, and modify the limits of integration 
appropriately: f F(g{x))g' (x)dx= (° F(u)du. 

Ja Jg(a) 

In effect, the integral is over a path on the //-axis traced out 
by the function g. (If g(b) = g(a) [the path returns to its 
start], then the integral is zero.) E.g., u = l+x 2 yields 

f 1= zr^dx=~ f 1 ir^2 x dx=hnil+x 2 ). 

Substitution may be used for indefinite integrals. 

E.g.,/ I ^rf,= i/f = iln U =lln(l + ^). 

Some general formulas are: 

fg(x) n g'(x)dx=^^J^dx=\n\g(x)\, 
J n + l J g{x) 

fe g(x) g r (x)dx=e 9ix) . 

•Integration by parts. Explicitly, 

f u(x)v' (x)dx=u(x)v(x)\ h — f v(x)u'(x)dx. 

J a \a J a 

The common formula is f udv = uu\ b —f v du. 

J a la J a 

For indefinite integration, Ju dv=uv— Jv du. 

The procedure is used in derivations where the functions 
are general, as well as in explicit integrations. You don't 
need to use "//" and "v." View the integrand as a product 
with one factor to be integrated and the other to be 
differentiated; the integral is the integrated factor times the 
one to be differentiated, minus the integral of the product 
of the two new quantities. The factor to be integrated may 
be 1 (giving v=x). 

E.g., j arctan x dx—x arctan x— f^* 2 dx 



Other routine integration-by-parts integrands are arcsinx, 
\nx, x^lnx, jcsinjr, jccosjc, andxe"*. 
'Rational functions. Every rational function may be 
written as a polynomial plus a proper rational function 
(degree of numerator less than degree of denominator). A 
proper rational function with real coefficients has a partial 
fraction decomposition: It can be written as a sum with 
each summand being either a constant over a power of a 
linear polynomial or a linear polynomial over a power of a 
quadratic. A factor (x— c)* in the denominator of the 
rational function implies there could be summands 
Ai , , A k 
x ~ c "' (x-c) k ' 

A factor (x 2 +bx+c) k (the quadratic not having real roots) 
in the denominator implies there could be summands 
Ai+Bix . , Ak+BkX 
x 2 +bx+c "' (x 2 +bx+c) k ' 

Math software can handle the work, but the following case 

C , D 

b 



should be familiar If a * b, 



(x-a)(x-b) x-a 



where C, D are seen to be C= 



-D= 



1 



Thus [-, n z-.dx= — 3— ( In I je — a\ — lnlx— 61). 

J(x— a)(x— b) a — b 

In general, the indefinite integral of a proper rational function 

can be broken down via partial fraction decomposition and 

linear substitutions (of form u = ax+b) into the integrals 

ju - 1 du,j u" du(n>l),fu(u 2 + 1) " " du (handled with 

substitution w=u 2 +l), and /(it 2 +l) tt du (handled with 
substitution w=tan /). 



IMPROPER INTEGRALS 



► Unbounded limits. If /is defined on [a,oo] and integrable 
on [a,B] for all B>a, then / j\x)dx = lim / f(x)dx 
provided the limit exists. 
E.g., f c °e- x dx=\im(l-e B )=l 

Likewise, for appropriate/ / f(x)dx — lim / f{x)dx. 

In each case, if the limit exists, the improper integral 
converges, and otherwise it diverges. For / defined on 
(-oo 3 oo) and integrable on every bounded interval, 

f°°f(x)dx = lim f c f(x)dx+ lim f f{x)dx (the 

J-od A-<^JA B-*ooJ c 

choice of c being arbitrary), provided each integral on the 
right converges. 

►Singular integrands. If / is defined on (a,b] but not at 
x = a and is integrable on closed subintervals of (a,b], then 

r b def r b 

/ f{x)dx — lim / f{x)dx provided the limit exists. A 

■J a c ~> a + -Jc 

similar definition holds if the integrand is defined on 

X2 1 r c 1 

, dx is lim / , dx — 



lim arcsinl 



21 T 



Singular Integrand 




If / is not defined at a finite number of points in an interval 
[a,b], and is integrable on closed subintervals of open 

intervals between such points, the integral / / is defined 

as a sum of left and right-hand limits of integrals over 
appropriate closed subintervals, provided all the limits exist. 



E.g., f -Kdx=\im f a -Kdx-\- lim f -K.dx if the 

J-IX 6 a-0-J-lX S b-O^b X* 

limits on the right were to exist. They don't, so the integral 
diverges. 

'Examples & bounds. 

jT ~^pdx converges for/?>l, diverges otherwise. 



J ~jidx converges for/j<l, diverges otherwise. 

J — ydx converges forj?>l, diverges otherwise. 



Note: f- f x - 
J x(\nxr 



-— j, p>\ converges at 



(n-l)(\nx) 
x=°°,p=0 or <1 diverges at x=oo. 

E.g., J -^dx converges to 1 and J -^dx diverges. 

The above integrals are useful in comparisons to 
establish convergence (or divergence) and to get bounds. 

/W X \ 3/2 

E.g., j ^j-j- — 2j dx converges since the integrand if 

bounded by 1/2 3/2 } on [0,1] and is always less than 1/j: 3 ' 2 
converges 



It 

23/2 



to 



than 



3/2 Ji x 3/: 



dx= 



1 

2 3/2 



+2<2.4. 



APPLICATIONS 



GEOMETRY 



•Areas of plane regions. Consider a plane region admitting 
an axis such that sections perpendicular to the axis vary in 
length according to a known function L(p), a<,p<,b. The 
area of a strip of width A/7 perpendicular to the axis at p is 

AA=L(p)/Sp, and the total area is A= f L(p)dp. E.g., 

Ja 

the area of the region bounded by the graphs of / and g 
over \a,b\ is f [g(x) — f(x)]dx , provided g(x)z f(x) on 

Ja 

[a,b]. Sometimes it is simpler to view a region as bounded 
by two graphs "over" the j-axis, in which case the 
integration variable is y. 



Planar Area 

AA=L(p)Ap=(g(p)-f(p))Ap 



Volume 



AV=A(p)Dp 




'Volumes of solids. 

Consider a solid 
admitting an axis such 
that cross-sections 
perpendicular to the 
axis vary in area 
according to a known 
function A(p), a<p^b. 
The volume of a slab of 
thickness Ap perpendicular to the axis at p is AV=A(p)Ap, 

and the total volume is V— f A(p)dp. E.g., a pyramid 

Ja 

having square horizontal cross-sections, with bottom side 
length s and height h, has cross-sectional area 
A(z)~[s(X— z/h)] 2 at height z- Its volume is thus 

'Solids of revolution. Consider a solid of revolution 
determined by a known radius function r(z), a<z<>b, along 
its axis of revolution. The area of the cross-sectional 
"disk" at z is A(z)=itr(z) 2 , and the volume is 

V=f h A(z)dz=f h nr(z) 2 dz. 

Ja Ja 

If the solid lies between two radii r\(z) and r 2 (z) at each 
point z along the axis of revolution, the cross-sections 
are "washers," and the volume is the obvious 
difference of volumes like that above. Sometimes 
a radial coordinate r, a^/-<A, along an axis 
perpendicular to the axis of revolution, 
parametrizes the heights h(r) of cylindrical 
sections (shells) of the solid parallel to the axis of 
revolution. In this case, the area of the shell at r is 
A(r) = 2jtrh(r), and the volume of the solid is 
V— f b A(r)dr= f b 2nrh(r)dr. 

Ja Jq 



2 



• Arc length. A graph y=f(x) between x=a andx=b has length 
V=f Jl+f'(x) 2 dx. A curve C parametrized by ((x(t), 

->a 

y(t)), a^t<,b, has length f ds= [ Jx'(t?+y'd(t?dt. 

•'C •'a 

•Area of a surface of revolution. The surface generated by 
revolving a graph y=f(x) between x=a and x=b about the 

x-axis has area / 2jr fix) J 1 +/' (x) 2 dx . If the 

generating curve C is parametrized by ({x(t), y(t)), 
a<,t<,b, and is revolved about the x axis, the area is 

f 2nyds= ( b 2ny(t)<J x' (t? +y' it? dt . 



PHYSICS 



•Motion in one dimension. Suppose a variable 
displacement x(t) along a line has velocity v(t)=x'(t) and 
acceleration a(t) = v'(t). Since v is an antiderivative of a, 
the fundamental theorem implies: v(/) = v(* 0 ) + 

f t a(u)du,x(t)=x{t{))+ ( f v{u)du. E.g., the heightxf/) 

■'fa ■'fa 

of an object thrown at time f 0 =0 from a height a'(0)=jc 0 
with a vertical velocity v(0)=v 0 undergoes the acceleration 

-g due to gravity. Thus v(t) = v( v 0 ) + jf { — u)du = v 0 -gt 

and x(i) = x 0 + j(v<\ —gu)du = x 0 + v 0 t-^gt 2 . 

•Work. If F(x) is a variable force acting along a line 
parametrized by x, the approximate work done over a small 
displacement Ax at .v is AW=F(x)Ax (force times 
displacement), and the work done over an interval [a,b] is 

W= f b F(x)dx. 

•Ja 

In a fluid lifting problem, often AW= AF*h(y), where 
h{y) is the lifting height for the "slab" of fluid dX y with 
cross-sectional area A(y) and width Ay, and the slab's 
weight is AF=pA(y)Ay, p being the fluid's weight-density. 

Then W= f h pA(y)h(y)dy. 



DIFFERENTIAL EQUATIONS 



•Examples. A differential equation (DE) was solved in the 
item Solution to initial value problem; an example of that 
type is in Motion in one dimension. In those, the expression 
for the derivative involved only the independent variable. A 
basic DE involving the dependent variable is y'=ky. A 
general DE where only the first-order derivative appears 
and is linear in the dependent variable is y'+p{t)y = q{i). 
Generally more difficult are equations in which the 
independent variable appears in a \hlt{ nonlinear} way; 
e.g., y'=y 2 — x. Common in applications are second-order 
DEs that are linear in the dependent variable; e.g., 
y"=-ky, x 2 y"+xy'+x 2 y = 0. 

•Solutions. A solution of a DE on an interval is a function 
that is differentiate to the order of the DE and satisfies the 
equation on the interval. It is a general solution if it 
describes virtually all solutions, if not all. A general 
solution to an nth order DE generally involves n constants, 
each admitting a range of real values. An initial value 
problem (IVP) for an nth order DE includes a specification 
of the solution's value and /i-l derivatives at some point. 
Generally in applications, an IVP has a unique solution on 
some interval containing the initial value point. 

•Basic first-order linear DE. The equation y'=ky, 

rewritten ^jr = ^V suggests -^=kdt where \y\=kt+c. In 

this way, one finds a solution y=Ce kt . On any open 
interval, every solution must have that form, because 

y'=ky implies j^0v e_A O» where ye~ kt is constant on the 

interval. Thus y=Ce kt (C real) is the general solution. The 
unique solution with y(a)=y a is y=y a ^ k ^~ a ^ The trivial 
solution is jsO, solving any IVP _y(a)=0. 

•General first-order linear DE. Consider 
y'+p(t)y=q(t)- The solution to the associated 
homogeneous equation h'+p(t)h=0(dhfh =-p(t)dt) 

with h(a)=l is )=exp|— J p(u)c?uj. 

If y is a solution to the original DE, then (ylh)'=qlh, 

where y = hjqfh. The solution with y{a) = y a is 

y(t)=Y a -^- f^irihiur 1 du\. 



APPROXIMATIONS 



TAYLOR'S FORMULA 



•Taylor polynomials. The nth degree Taylor polynomial of 
/at c isP„(x) =f(c) +f'(c)(x-c) + \\f"{c){x-c) 2 +...+ 

jjjf( n Xc)(x—c) n (provided the derivatives exist). When 

c=0, it's also called a MacLaurin polynomial. 
•Taylor's formula. Assume / has n+1 continuous 
derivatives on open interval and that c is a point in the 
interval. Then for any .v in the interval, f(x)=P n (x)+R n (x), 

where R,(x) = 

between c and x varying with x). The expression for 
R„(x) is called the Lagrange form of the remainder. E.g., 
the remainders for the MacLaurin polynomials of f(x) = 

ln(l+A-), -1<at<1, are RJx) = — ' ,. • x» +1 . 

(n+l)(l+f)" +1 

There is a £ between 0 and x such that ln(l + x) = 



, + " (x-c)" +l for some % 



* 2 + 3(l+ ^- 

•Error bounds. As x approaches c, the remainder generally 
becomes smaller, and a given Taylor polynomial provides a 
better approximation of the function value. With the 
assumptions and notation above, if ^f ( - n+li (x)\ is bounded 
by M on the interval, then \f(x)—P„ (x)\ 

M i \n-\\ 



(n+D! 



\x—C n for all x in the interval. E.g., for |.v|<l, 



e x =l+x+x 2 /2, with error no more than ^yl-^l 3 — 0.5|jc| 3 , 

because the third derivative of e x is bounded by 3 on (—1,1). 
► Big O notation. The statement / (x) =p(x) + 0(x"') 

(as x— »0) means that ~~^^~ H ls bounded near x=0. 
(Some authors require that the limit of this ratio as x 
approaches 0 exist.) That is, fix)— p(x) approaches 0 at 
essentially the same rate as x m . E.g., Taylor's formula 

implies f(x)=f(0)*f'(0)x+^f"(0)x 2 +O(x 3 ) if / has 

continuous third derivative on an open interval containing 
0. E.g., sinx=x+0(x 3 ). [Similar relations can be inferred 
from the identities in the item Basic MacLaurin Series.] 
•CHopital's rule. This resolves indeterminate ratios or 

(£or^). If lim/(jc)= 0 = limffCx) and if lim'/Oc) = 0 

\U / x — a x—a x—a 

= lim' g(x) are defined and g(x)#Q, for x near a (but not 

JC-*Q 

necessarily at a), then lim ^^=0=lim —. provided 

x^a g(x) x->a g ( X ) 

the latter limit exists, or is infinite. The rule also holds 
when the limits off midg are infinite. Note that f'(a) and 
g'(a) are not required to exist. To resolve an indeterminate 
difference (oo-oo), try to rewrite it as an indeterminate 
ratio and apply L'Hopital's rule. To resolve an 
indeterminate exponential (0°,l* J oroo*) ) take its logarithm 
to get a product and rewrite this as a suitable indeterminate 
ratio; apply L'Hopital's rule; the exponential of the result 
resolves the original indeterminate exponential. 

For lim | x \ x you get and find lim v _»J n ^ =liin v _ > / ( ., = 0, 

x-0 1/jC —\jX l 

where lim [xf* = e°= 1. 

x-Q 



NUMERICAL INTEGRATION 



•General notes. Solutions to applied problems often 
involve definite integrals that cannot be evaluated easily, if 
at all, by finding antiderivatives. Readily available 
software using refined algorithms can evaluate many 
integrals to needed precision. The following methods for 

approximating / °f{x)dx are elementary. Throughout, n is 

the number of intervals in the underlying regular partition 
and h=(b-a)/n. 

•Trapezoid rule. The line connecting two points on the 
graph of a positive function together with the underlying 
interval on the x axis form a trapezoid whose area is the 
average of the two function values times the length of the 
interval. Adding these areas up over a regular partition 
gives the trapezoid rule approximation 



/(a) 
2 



fib) 
2 



+ 2 f( a ~ ih) + ' L ^)h. This is also the 



average of the left sum and right sum for the given partition. 
The approximation remains valid if /is not positive. 
•Midpoint rule. This evaluates the Riemann sum on a 
regular partition with the sampling given by the midpoints 

of each interval: M n — J] /(a+[/— T^h^Jh. Each 

summand is the area of a trapezoid whose top is the 
tangent line segment through the midpoint. 

1 2 

'Simpson's rule. The weighted sum sTi + giHi on the 



interval 



yields 



Simpson's 



rule 



" 6 V vtt/ V 2 
This is also the integral of the 
quadratic that interpolates the 
function at the three points. For 
a regular partition of [a, b] into 
an even number n=2m of 
intervals, a formula is: 

i m— 1 m—l 

S 2 „=4{f(a)+i £/(a)+[2/+l]A+2 £/(«+2Mi )+/{&)} 
where h = {b - a)ln. Simpson's rule is exact on cubics 




SEQUENCES & SERIES 



SEQUENCES 



•Sequences. Sequences are functions whose domains 
consist of all integers greater than or equal to some initial 
integer, usually 0 or 1. The integer in a sequence at n is 
usually denoted with a subscripted symbol like a lt (rather 
than with a functional notation «(«)) and is called a term 
of the sequence. A sequence is often referred to with an 
expression for its terms, e.g., \ln (with the domain 
understood), in lieu of a fuller notation like: 
{1/n}^, or/i|^l/n(n=l, 2, ...)• 

•Elementary sequences. An arithmetic sequence a„ has a 
common difference d between successive values: 
a l =a ll _ i +d=a Q +d M n. It is a sequential version of a linear 
function, the common difference in the role of slope. A 
geometric sequence, with terms g„, has a common ratio r 
between successive values: gn~Sn-t r ~So ra - E.g., 5.0, 2.5, 
1.25, 0.625, 0.3125,.... It is a sequential version of an 
exponential function, the common ratio in the role of base. 

' Convergence. A sequence {a n } converges if some number 
L (called the limit) satisfies the following: Every £>0 
admits an N such that \a, —L\< e for all n > N. If a limit L 
exists, there is only one; one says {a„}converges to L, and 
writes a n —>L, or lim a n = L. If a sequence does not 
converge, it diverges. If a sequence a n diverges in such a 
way that every M> 0 admits an such that a„>M for all 
naiV, then one writes a„~*t». E.g., if |r|<l then r"— *0; if 
r=l then r"-*\; otherwise /*„ diverges, and if r>l, r B — *oo, 

■Bounded monotone sequences. An increasing sequence 
that is bounded above converges (to a limit less than or 
equal to any bound). This is a fundamental fact about the 
real numbers, and is basic to series convergence tests. 



SERIES OF REAL NUMBERS 



•Series. A series is a sequence obtained by adding the 

N 

values of another sequence ^]a n = a () +.>.+a N . The value 

n=0 

of the series at TV is the sum of values up to a N and is called 

N 

a partial sum: ^a, l ^a {i J t,„+a N . The series itself is 
™ «=o 

denoted /]a n ■ The a n are called the terms of the series. 

n=o °° 
• Convergence. A series ^,a n converges if the sequence of 

n=p 

partial sums converges, in which case the limit of the 
sequence of partial sums is called the sum of the series. 
If the series converges, the notation for the series itself 

CO N 

stands also for its sum: = lim ■ 

n — (\ N-<x> n = ti 



3 



Series continued 



1=2. 



An equation such as ^ J a„ = S means the series converges 
and its sum is S. In general statements, may stand for 

n-0 

• Geometric series. A (numerical) geometric series has the 
form ^ar n , where r is a real number and a * 0. A key identity 

n = 0 

JV, 1__A r +l 

is 2-j r " = 1+r+rl+ - +rN= ^rz: (r=£l). It implies 

n=o 1 r 

£ r " = fz^ if I f l< l)f also f>r" = a ( j^; - 1 jj, and 

that the series diverges if \r\>\. The series diverges if 
r=± 1. The convergence and possible sum of any geometric 
series can be determined using the preceding formula. 

• p-series. For p, a real number, ^ — -p is called the p-series. 

The p-series diverges if p<,\ and converges if p>\ (by 
comparison with harmonic series and the integral test, 

below). The harmonic series ^ — diverges, for the partial 
sums are unbounded: Y^l+^f . 

n = i n 1 

•Alternating series. These are series whose terms alternate 
in (nonzero) sign. If the terms of an alternating series 
strictly decrease in absolute value and approach a limit of 
zero, then the series converges. Moreover, the truncation 
error is less than the absolute value of the first omitted 

co N 

term: J] (— l)"a„ — — l)"a n <cin+i. (assuming 

n=l n=l 

a„— »0 in a strictly decreasing manner). 



CONVERGENCE TESTS 



'Basic considerations. For any K, if J]a" converges, then 

oo " = K 

^a" converges, and conversely. If a n ^ 0, then 

n=i 

diverges. (Equivalently, if converges, then a n — »0). This 

says nothing about, e.g., ^] ^ . A series of positive terms is 

an increasing sequence of partial sums; if the sequence of 
partial sums is bounded, the series converges. This is the 
foundation of all the following criteria for convergence. 
•Integral test & estimate. Assume / is continuous, 

positive, and decreasing on (AT,°°). Then ^f(n) converges 

. n=K 
if and only if / f(x)dx, converges. If the series 

N , „ 

converges, then ^ f(n)< ^ f(n)+ fix)dx, the 

n=K n=K N 

right side overestimating the sum with error less than 

12 



2 -i« £ i+ f"^3efc=1.2018..., the left side 

n-l n n-l n 13 x 

underestimating the sum with error less than f(N+l). 
Integral test 




n = l n n = l" ylJ x 



underestimate with error <13~ 3 <5"10~ 4 . 
•Absolute convergence. If 2l a «l converges, that is, if 
2 a » {converges absolutely}, then ^a„ converges, and 



^ ser i es converges conditionally if it 



converges, but not absolutely. 
•Comparison tests. Assume a„,b„>0. 

-If ^jbn converges and either a„£b„(n>N) or a„/b„ 

has a limit, then ^a„ converges. 



-If "Yjbn diverges and either b„£a„(n>N) or a„/b„ has 
a nonzero limit (or approaches °°), then diverges. 
The /7-series and geometric series are often used for 
comparisons. Try a "limit" comparison when a series 
looks like a p-series, but is not directly comparable to it. 

c v- • It I 2\ v sin(l/V) 
E.g., Vsin(l/n z ) converges since urn 1. 

'Ratio & root tests. Assume «„*0. 
If lir J"" 1 ^ <1 or lim a n ' "<1, then Y!a„ converges 

n -*oo an n-*°°' — 

(absolutely). If lin J"" ^ >lor lim a a 1 ">1, then 

n-*«= Or n-»°° 

diverges. These tests are derived by comparison with 
geometric series. The following are useful in applying the 
root test: limn'"'"=l (any n) and lim(n!) 1/ " =oo. More 

precisely, lim knl) 1 '" = \. 



POWER SERIES 



•Power series. A power series in a: is a sequence of 

N 

polynomials in a: of the form ^a n x" (N—0, 1, 2, ...). 

n=0 

The power series is denoted ^anX n ■ 
A power series in x-c (or "centered at c" or "about c") is written 
^a n {x— c) n =ao+ai(x— cJ+asGe— c) 2 + .... 

n=Q 

Replacing x with a real number q in a power series yields 
a series of real numbers. A power series converges at q if 
the resulting series of real numbers converges. 
1 Interval of convergence. The set of real numbers at which 
a power series converges is an interval, called the interval 
of convergence, or a point. If the power series is centered 
at c, this set is either (i) (-00,00); (ii) (c-R,c+R) for some 
i?>0, possibly together with one or both endpoints; or (iii) 
the point c alone. In case (ii), R is called the radius of 
convergence of the power series, which may be 00 and 0 
for cases (i) and (iii), respectively. Convergence is absolute 
for \x-c\<R. You can often determine a radius of 
convergence by solving the inequality that puts the ratio 
(or root) test limit less than 1. E.g., for 



2, 2^ il^+Mn + l) 2 \x\" ~ 2 <ls *l*K* 
which, with the ratio test, shows that the radius of 
convergence is 2. 

■Geometric power series. A power series determines a 
function on its interval of convergence: 

JC I — * fix)— ^Cln (x — c)" . One says the series converges 



2"ra 2 _|x| 



to the function. The series ^x", i.e., the sequence of 

n = 0 



polynomials ^x"=l+x+.r ! +...+i* 

n=0 



1-x 



converges for x in the interval (-1,1) to 1/(1— x) and 



diverges otherwise. That is, ^ x" - 

n=0 



1 

1-x 



(W<l). Other 



geometric series may be identified through this basic one. 

for 



E.g., 22-3"^"=2fi;(f 



2x . 1 

n=0 u n=0 N "' ' 1— jc/3 

|x/3[<l. The interval of convergence is (-3,3). 
■ Calculus of power series. Consider a function given by a 
power series centered at c with radius of convergence R: 

f(x)=f l a„(x-cr. 

Such a function is differentiable on (c-R, c+R), and its 

derivative there is /' (x)= ^na,, (x — c)" 1 . 

n=l 

The differentiated series has radius of convergence R, but 
may diverge at an endpoint where the original converged. 
Such a function is integrable on (c - R, c + R), and its 
integral vanishing at c is: 

ff(t)dt= f, -^r(x-c)" >H\X-C\<R). 



The integrated series has radius of convergence R, and may 
converge at an endpoint where the original diverged. 

E.g., zr-^— = 1— x+x- ■■• implies — 1— x+x 2 ---. 

The initial (geometric) series converges on (—1,1), and the 
integrated series converges on (1,-1). The integration says 



\na+x)=^(-l) n 



for |jc|<1; a remainder 



argument (see below) implies equality for x=l. 
Taylor and MacLaurin series. The Taylor series 
about c of an infinitely differentiable function / is 

f:^^(x-c) h ^f(c)+f\c)(x-c) + ^(x-c) 2 +- 



2! 



If c = 0, it is also called a MacLaurin series. The Taylor 
series at x may converge without converging to f(x). It 
converges to f(x) if the remainder in Taylor's formula, 

R n(x) = { - / ^yy / ( " 1 1) (^)-(x-c) ( " 1 1] (1 between c and x, 

^ varying with x and n), approaches 0 as n— »oo. E.g., the 
remainders at x=l for the MacLaurin polynomials of 
ln( 1 + x) (in Taylor's formula above) satisfy 

^ (1)|= (nS)(br^^- 

soln2=£ ( -^p. 

n=i 

•Computing Taylor series. If R>0 and 

f(. x ) = ^jCliAx— c)"(\x— c\<R), then the coefficients are 

necessarily the Taylor coefficients: a n =f^(c)/n!. This 
means Taylor series may be found other than by directly 
computing coefficients. Differentiating the geometric 

series gives - — ^^ = jC«Jc"" 1=: ^(n+l)x n (\x\<l). 

•Basic MacLaurin series: 

t ^=1+.v+a: 2 +...= £x" (M<1) 

ln(l+A:)=A:-^+^-...= |;(-l) ( " +1, ^(-l<x<l) 



lni±^ = 2U+^- + ^- + - 
1-x V 3 5 



arctan x=x-^- + 
i 5 



The following hold for all real x: 



; S(-l)"^7TT {\X\<1) 



2n+l 



COS X = 1 — X + 7^- + ^ 



Sin X = X~ §r + ^r 

o! 5! 



Binomial series. For 0, and for |x|<l, 



n=0"' 
_y^ (-l)"jC 2 " 

,h (2«)! 
_f^ (-l)"x 2 " +1 
'to (2«+D! 



a+x) 



The binomial coefficients are 

p(p-l)(p-2)-(p-k+l) 
kl 



If p is a positive integer, [ j=0 for k>p. 



ii-oW 

'■0 
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